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An upp^r^^symptote^parameter was added to the three-parameter 
logistic item response model. This four-parameter model was' compared 
to the three-parameter model on four data sets. The fourth parame.^r 
increased the likelihood, in only two of the four sets. Ability' 
estimates for the students were generally unchanged by the introduction 
•of the four th parameter . ^ 




Arv Upp^r Asymptote for the Thr-ee-Parameter Logistic i^^em-Response Model* 

' Mark A. Barton' 



\ 

and 



Frederic M. Lord 



A two-parameter logistic item-response model ma^ be expressed a§ 

-i,7a (e-b ' 
F(0) = (1 + e ^ ^ )"^^ 



.where F(6-') . is the probability .of a student witlf "ability 9 vpassing 

J 

item ,g . The ^)robability of passing ranges from zero to one^^ 0 
go^es from -<» to «> ' . ^ 

. On a multiple choice test, however, t|;ie ^probability of choosing the' 
correct answer does not approach zero for ^ow-ability students. For this 
reason, a low^r asymptote is introduced. The resulting three-parameter 
model is ' . - 

G(e) = c + (1 - c)F'(e) 

where the lower asymptote; sometimes referred to as .a guessing' parameter," 

may be set arbitrarily; .or a common value may be . estimated fi^om the data; 

or individual values may be estimated from the data separately for each ' 

' * * ' *» • ' 

item.' ' ' / • ' 

An upper asymptote may likewise be introduced into the jmodel : 

P(0);= c + (6 - c)F(6) . ^ . . 

While F(e) ranges from zerp to. one, P(6> ranges from- the lower 
asymptote, c , to the uppqgr asymptote, 6 . , . ' 



J * *This work was supported in part- by, contract . Np00l4-80-C-0402 , 
project designation NR15Q-453 between the Office ofj Naval' Research and 
Educational Testing Service. Reproduction in whoLe or in part is* 
permitted for any' purpose of'ttie United States Government., 



'Even a high-ability student may make a cl^ical error in answering 

^ ; » • ' r ^ r. 1 r 

an easy Ltem. The introduction of an upper asymptote with a valu^ or ^ 

slightly less than 1 should allow high-ability stud^t to miss an 

easy it^m without having his abilit}|^ e$timate dr^astically flowered. 

This study of the upper-asymptote model was motivated ^.argely bv. 
• .1 . ' ^ ' 

the concern that the three-parameter model might be severely penalizing 
high-ability students .'who* make a clerical error on an easy iteij^^ The 
dhree^paramet^^ model was compared to the upper-asymptate (four- 
pararaeter) model for'^four dat^a setsjylAT . Verbal , ?AT Math, GRE Verbal, 

and AP Calculus AB. * ' * ' ' ' ■ ' . 

' ^ \ ' ' ' ^ ♦ . * 

* • rii'e tests-, . all ut which were developed -by Educational "^stii^l^ 

... cr 

Service, are described briefly: , ' * ' . 

Scholastic Aptitude Test XSAT) , Vei^bal : The SAT is a 75-minute, 

^, • ^ . y 

90-item verbal*test cfesigned, for applicants to uhdergraduatfe^ study . 
Til litems are five choice. " ^ • ^ 

Scholastic Aptitude -Test (SAT)* / tlal?!! : The mathematical part of 



the SAT (from a different form' of the test, with different- students) ^ / ' 

was analj^zed .as a^ separate data set. This 90-minute t;es^t has 85 items, 

* • * ^ - . 

20 of which are four choice, and 65 of which are five choiQe.* 

* ^ 

Graduate Record Ex^minapion ^GRE) Aptitijde Test, Verbal : ''"this 
test of verbal reasoning and Reading comprehension is designed for 
applicants to grad'«ate study, All^of -ttie itfms on this 50-minute, 



80-item test are five-cho*ice items. 



College Boa^d Adv.a'nced Rlacement (AP) Examination— Mathematics : 
Calculus AB r This is a test taken by high sciiool students in order 
to rece'ive college credit for their knowledge of ^elementary functions 
andsf irst-semester qalculus. The* essay items were not included i n Ihis 
analjL^s. The objective portion ^^lasts 90 minutes ^and -has 43 item-. 
All -of the items/are five choice. * . / • 

( For each of the foyr data sets, tl^following procedure was used: 
/1-) Ability and item parameters were est'imated under the 

tKree-paramet er model using the program LOGI-ST (Wood & Lofd, 
^ 1976; Wood; Wingersky, & Lo'rd, 1976) ^ ,wi th several thousand 

students. '(These runs were already available.) 
2) In ordeLr to reduce costs, a random 'subsample of 

-1000 students was chosen. . • . * * ' 

'3^ With the ^ parameters (guessing parameters )^ held 

fixed at the p]^*eviously estimated values (to reduce ^ 
costs), the Remaining ,it em parameters ( a 'sj and- b 's)' 
and the abilities ( 6 ^s) were reestimated for just the 
IQOO students with> 5'='*1.00. * ^ 

4) With the c^ parameters still held fj^ed, the a /s, b 's, 
and e 's'^ere estim^^feeii • with upper asymptote values of 
•6 = . 99 and" 6 = .98 , using a modified version of 
LOGIST on th^ sample of ,1000 students. 



\ 
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"The effect of the Tipper asymptote was measured in two ways-* 

First, likelihoods were computed for each value of the upper 

• * * * ' ^ * 

asymptote ( 6 = l.OO' , 6 = ,99 6 = -98), and^the asymptote value* 

with the highest likelihood wa,s considered the best fit. In two of 

the causes XGRE^^e^bal and AP 'Calculus AB) the highest likelihood was 

obtained with*^ 6 = 1 • OCT (the standard three-paramfet^r model), and in 

the other two cases (SAT Math and SAT Verbal) the highdst likelihood, 

was abtainec^ with 6 = .9^ . In none' of the four data sets did the 

highest and the lowest 'of the three log-likelihoads differ by more than 

♦ 

0,02% (more than .000^). 

' gecond, ability estimates under the two asymptote* values 6 = 1.00 

\ 

and 6 = .99 were tiompared to see whether t\\e change m upper- 
asymp^tote value had a large effect on the ability estimate of any ^ 
individual student. Out of the 4000 students examined in the four 
data sets, the greatest change was an increase of ♦64 under th6 .99 
upper-asymptote model. The five students most affected are^ummarized 
*in Table 1. Two of these were- very high-ability students, and the other 
three were very -low-ability students. The ability estiinate changed 
by -more than the standard 'error oT estimat'e in only one of the. five 
CAses. • In all fJLVe cases, the . 99-upper-asymptote , model favored the 
student. The largest drop in a student's ability estimate under tHe ^ 
. 99-upper-asymptote model was^.36, for a student of very low ability 
on the*GRE VerjDal. Ail 1000> students who took the t3RE are plotted 
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Table 1 ' ' 
The Five Students with -the Largest Absolute Changes 
' ' in Theta out of 4000 Examined 



r 



^5=1.00 " ' ^6=.99 , ^5=.99"^6=t.OO 

2:9 3.4 • 0.5- , 

.2.8 ■ ■ 3.3 0. 5 • " 

>-3.? -3.3 0.6 

-5.6 . -4.4 • 0.6 . . 

-5.9 ^ -5.4 ' ■ 0.5 



Standard' Error 
of Measurement 

0.7 
1.1 
2.7 
4.8 



Test 

GRE Verbal 
. AP Calculus AB 
SAT Verbal 
GRE Verbal . 
GRE Verba; 



Thetas have a mean of 0 ^nd a standatd- deviation of 1, 



in Figure 1; in the plots for- the other three 'data' sets , points were ^ 
even, closer to the identity line, 

One might expect more clerical errors to be made on a highly 
speeaed *Xest, This might result in the ,99~upper~asymptote model fitting 
be'tter than the 1 • 00-upper-asymptote model, The only highly, speeded 
test of the four, the GRE Verbal, was fit best with the l.OO^upper- 
asymptote model, Kowever, discounting this speededness hypothesis • 

In view of -the failure of the fo6r-parameter' model either to 
consistently imo^ve the likelihood or to significantly change any 
ability estimates .there is, no compelling reason to ur'ge the use of this 
model. * The extra computational/ time required for the more complex 
derivatives further argues against its use. 

• . • • ^\ 

One positive resuit of this. study is that.it suggests that the 
three-parameter iQgistic model -does a better job of ^fitting high- 
ability students than some researchers (including the authors) had * n 
expected. Had we examined the normal-ogive model instead,* which is Q 

I . . ■ ■ ■ ^ 

l/s^ forgiving of; incorrect answers to easy items by high-ability 

students^ we would possibly have found a stronger case for the. 

^ . ' * - \ ' 

'adoption of an upt>e;r asymptote of .99 ot .98. \ 



J 
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Append'ix 



Formulas for derivatives of the f our-pararaet^er model* : c , 

n = number of items* ♦ 

N = number of subj.ects. ~ " ' . . 

D = 1.7 .... ■ " ■ , . * • ■ . . ' 

6 •= uppe^ asyilptote. * / * ' \ - 

u = observed response (1 df right, 0 if wrong) for item ^ i •, subject j 



•L.. . = a. (0 . - b.) 



P . =.c. + (6 - c.)/(l.+ e 
. = 1 - P. . * 

■ * ■ / • ■ 

The log likelihood is given by > 

n N , « , 

. / = V ?: ■ fu- . InP . + (1 - u. .)lnQ. t] • (Lord, p. 58) 

i=l j=l V 

< • V 

Xhe ta derivatives : 




, /9e. 

^ = r (u - P ) ^ 



and 




■Li 



*The authors -are graceful to Kirsten Yocom for verifying al>l^ 
the deriva'tives. , 
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where 



36 DL, . . --DL., 



and 



y ^ ^ DL, . -DL. . 

3^P. . -(6 - c^)D a^(e - e 

,^2 " DlT^ -DL, . • ^ 

J (e ^ + 2 + e ^) 



' Item-payametef derivatives ; *^ 

' ^^We^ill drop subscripts for brevity in the following formulas 



^ If X represents a. , ^fe. , or c. , and if^ represents a 

^i ' ^i ' ^^^^ 
r 

N ( 1^ ) 



and 



BP 3P ' ' 8^P 

iiL = f r ¥ii.-9X \ (u 1 p)r lEill., ( PL 
axa-j- ^ PQ^ + U fH pQ ^ ^ 3x 3* ^ «2 




-A3- 



where 



/ 



' 1 



3P (6 - c)D(9' - b) 



3P _ -(6 - c)Da • 

ab ,~ DL „ , -DL 
e + 2 + e 



3P 



1 + e 



DL 



(6 - C)D (9 - b) (e - & ) 

/ DL ^ . ^ -DL.2 
(e + 2 + e ; 



^'2^' /r ^T^2 2. DL -DL, 
a P ^ -(6 - c)D a (e - e ) 

Bb (e + 2 + e ) 



= 0 



_afp ^ '(5 - c)D^a(9 - b)(e'^ - e _ '0(6 - c) 
aa3b - (^DL ^ 2 + e-^S^ - , T^^lTTTT^ 



3a3c 



-P(9 - b) 
e + 2 + e 



and 



Da^ 



?bjO DL ^ o -L ' "DL 
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